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Abstract 


We consider Sherali-Adams linear programming relaxations for solving valued constraint 
satisfaction problems to optimality. The utility of linear programming relaxations in this con¬ 
text have previously been demonstrated using the lowest possible level of this hierarchy under 
the name of the basic linear programming relaxation (BLP). It has been shown that valued 
constraint languages containing only finite-valued weighted relations are tractable if, and only 
if, the integrality gap of the BLP is 1. In this paper, we demonstrate that almost all of the 
known tractable languages with arbitrary weighted relations have an integrality gap I for the 
Sherali-Adams relaxation with parameters (2,3). The result is closely connected to the no¬ 
tion of bounded relational width for the ordinary constraint satisfaction problem and its recent 
characterisation. 

1 Introduction 

The constraint satisfaction problem provides a common framework for many theoretical and practi¬ 
cal problems in computer science. An instance of the constraint satisfaction problem (CSP) consists 
of a collection of variables that must be assigned labels from a given domain subject to specified con¬ 
straints. The CSP is NP-complete in general, but tractable fragments can be studied by, following 
Feder and Vardi m, restricting the constraint relations allowed in the instances to a fixed, finite set, 
called the constraint language. The most successful approach to classifying the language-restricted 
CSP is the so-called algebraic approach 

An important type of algorithms for CSPs are consistency methods. A constraint language is 
of hounded relational width if any CSP instance over this language can be solved by establishing 
(/c, ^)-minimality for some fixed integers 1 < k <£[!]. The power of consistency methods for 
constraint languages has recently been fully characterised mm and it has been shown that any 
constraint language that is of bounded relational width is of relational width at most (2, 3) [1]. 

The CSP deals with only feasibility issues: Is there a solution satisfying certain constraints? In 
this work we are interested in problems that capture both feasibility and optimisation issues: What 
is the best solution satisfying certain constraints? Problems of this form can be cast as valued 
constraint satisfaction problems |16j . 

An instance of the valued constraint satisfaction problem (VCSP) is given by a collection of 
variables that is assigned labels from a given domain with the goal to minimise an objective 
function given by a sum of weighted relations, each depending on some subset of the variables [8]. 
The weighted relations can take on finite rational values and positive infinity. The CSP corresponds 
to the special case of the VCSP when the codomain of all weighted relations is {0, oo}. 

*The authors were supported by a London Mathematical Society Grant. Stanislav Zivny was supported by a 
Royal Society University Research Fellowship. 
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Like the CSP, the VCSP is NP-hard in general and thus we are interested in the restrictions 
which give rise to tractable classes of problems. We restrict the valued constraint language] that is, 
all weighted relations in a given instance must belong to a fixed set of weighted relations on the 
domain. The ultimate goal is to understand the computational complexity of all valued constraint 
languages, that is, determine which languages give rise to classes of problems solvable in polynomial 
time and which languages give rise to classes of problems that are NP-hard. Languages of the former 
type are called tractable, and languages of the latter type are called intractable. The computational 
complexity of Boolean (on a 2-element domain) valued constraint languages [8] and conservative 
(containing all {0, l}-valued unary weighted relations) valued constraint languages [18] have been 
completely classified with respect to exact solvability. 

Every VCSP problem has a natural linear programming (LP) relaxation, proposed indepen¬ 
dently by a number of authors, e.g. [6], and referred to as the basic LP relaxation (BLP) of the 
VCSP. It is the first level in the Sheralli-Adams hierarchy |2l|, which provides successively tighter 
LP relaxations of an integer LP. The BLP has been considered in the context of CSPs for robust 
approximability uniEoi and constant-factor approximation PIE]. Higher levels of Sherali-Adams 
hierarchy have been considered for (in)approximability of CSPs [111131] but we are not aware of any 
results related to exact solvability of (valued) CSPs. Semidefinite programming relaxations have 
also been considered in the context of CSPs for approximability [23] and robust approximability [2]. 

Consistency methods, and in particular strong 3-consistency has played an important role as a 
preprocessing step in establishing tractability of valued constraint languages. Cohen et al. proved 
the tractability of valued constraint languages improved by a symmetric tournament pair (STP) 
multimorphism via strong 3-consistency preprocessing, and an involved reduction to submodular 
function minimisation [7] . They also showed that the tractability of any valued constraint language 
improved by a tournament pair multimorphism via a preprocessing using results on constraint 
languages invariant under a 2-semilattice polymorphism, which relies on (3,3)-minimality, and 
then reducing to the STP case. The only tractable conservative valued constraint languages are 
those admitting a pair of fractional polymorphisms called STP and MJN [18]; again, the tractability 
of such languages is proved via a 3-consistency preprocessing reducing to the STP case. It is natural 
to ask whether this nested use of consistency methods are necessary. 

1.1 Contributions 

In [T7ll26] . the authors showed that the BLP of the VCSP can be used to solve the problem for many 
valued constraint languages. In [27], it was then shown that for VCSPs with weighted relations 
taking only finite values, the BLP precisely characterises the tractable (finite-)valued constraint 
languages; i.e., if BLP fails to solve any instance of some valued constraint language of this type, 
then this language is NP-hard. 

In this paper, we show that a higher-level Sherali-Adams linear programming relaxation [2l] 
suffices to solve most of the previously known tractable valued constraint languages with arbitrary 
weighted relations, and in particular, all known valued constraint languages that involve some 
optimisation (and thus do not reduce to constraint languages containing only relations) except 
for valued constraint languages of generalised weak tournament pair type [30]; such languages are 
known to be tractable m but we do not know whether they are tractable by our linear programming 
relaxation. 

Our main result. Theorem 0] shows that if the support clone of a valued constraint language 
T of finite size contains weak near-unanimity operations of all but finitely many arities, then T is 
tractable via the Sherali-Adams relaxation with parameters (2,3). This tractability condition is 
precisely the bounded relational width condition for constraint languages of finite size containing 
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all constants laizi], and our proof fundamentally relies on the results of Barto and Kozik [3] and 
Barto [I]. 

It is folklore that the A:th level of Sherali-Adams hierarchy establishes A:-consistency for CSPs. 
We demonstrate that one linear programming relaxation is powerful enough to establish consistency 
as well as solving an optimisation problem in one go without the need of nested applications of 
consistency methods. For example, valued constraint languages having a tournament pair multi¬ 
morphism were previously known to be tractable using ingenious application of various consistency 
techniques, advanced analysis of constraint networks using modular decompositions, and submod- 
ular function minimisation [?]• Here, we show that an even less restrictive condition (having a 
binary conservative commutative operation in some fractional polymorphism) ensures that the 
Sherali-Adams relaxation solves all instances to optimum. 

Finally, we also give a short proof of the dichotomy theorem for conservative valued constraint 
languages |18j , which previously needed lengthy arguments (although we still rely on Takhanov [25] 
for a part of the proof). 

2 Preliminaries 
2.1 Valued CSPs 

Throughout the paper, let H be a fixed finite set of size at least two. 

Definition 1. An m-ary relation over D is any mapping cj) : {c, oo} for some c € Q. We 

denote by the set of all relations on 1)0 

Let Q = Q U {oo} denote the set of rational numbers with (positive) infinity. 

Definition 2. An m-ary weighted relation over D is any mapping (p : D™ ^ Q. We write 
ar{<p) = m for the arity of p. We denote by the set of all weighted relations on D. 

For any m-ary weighted relation p £ we denote by Feas{(p) = {x € D™ | <^(x) < oo} G 
the underlying m-ary feasibility relation, and by Opt((;i)) = (x G Feas((/>) | Vy G D™ : 0(x) < <?i>(y)} G 
R/) the m-ary optimality relation, which contains the tuples on which (p is minimised. A weighted 
relation p : D™ —Q is called finite-valued if Feas((/>) = D^. 

Definition 3. Let V = {xi,... ,Xn} be a set of variables. A valued constraint over V is an 
expression of the form p{x) where G o-n-d x G The number m is called the arity of 

the constraint, the weighted relation p is called the constraint weighted relation, and the tuple x 
the scope of the constraint. 

We call D the domain, the elements of D labels and say that weighted relations take values. 

Definition 4. An instance of the valued constraint satisfaction problem (VCSP) is specified by 
a finite set V = {xi,..., Xn} of variables, a finite set D of labels, and an objective function I 
expressed as follows: 

q 

/(xi,...,xn) = ^</>i(xi), (1) 

i=l 

^ An m-ary relation over D is commonly defined as a subset of D’^. Note that Definition [T] is equivalent to the 
standard definition as any mapping p : D™' —^ {c, oo} represents the set i? = {x G D"* | p{x.) < oo} and any set 
R C D"' can be represented by pR : D’^ —>■ {0, oo} defined by pRpp — 0 for x G i? and pRpx.) = oo for x p R. 
Consequently, we shall use both definitions interchangeably. 
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where each (/)j(xj), 1 < z < g, is a valued constraint over V. Each constraint can appear multiple 
times in I. The goal is to find an assignment (or solution^ of labels to the variables minimising I. 

A solution is called feasible (or satisfying) if it is of finite value. A VCSP instance I is called 
satisfiable if there is a feasible solution to I. CSPs are a special case of VCSPs with (unweighted) 
relations with the goal to determine the existence of a feasible solution. 

Example 1. In the Min-UnCut problem the goal is to find a partition of the vertices of a given 
graph into two parts so that the number of edges inside the two partitions is minimised. For a 
graph (y, E) with V = {xi,..., Xn}, this NP-hard problem can be expressed as the VCSP instance 
I{xi ,..., Xn) = 4>xor{xi, Xj) over the Boolean domain D = {0,1}, where ■ {0,1}^ —>■ Q 

is dehned by (j)xor{x, y) = 1 x = y and 4>xor{x, y) = 0 x y. 

Definition 5. Any set A C R^) is called a constraint language over D. Any set P C is called 
a valued constraint language over D. We denote by VCSP(r) the class of all VCSP instances in 
which the constraint weighted relations are all contained in P. 

For a constraint language A, we denote by CSP(A) the class VCSP(A) to emphasise the fact 
that there is no optimisation involved. 

Definition 6. A valued constraint language P is called tractable i/VCSP(r') can be solved (to 
optimality) in polynomial time for every finite subset T' C P, andV is called intractable i/VCSP(r') 
is NP-hard for some finite P' C P. 

Example [T] shows that the valued constraint language {<()xor} is intractable. 

2.2 Operations and Clones 

We recall some basic terminology from universal algebra. Given an m-tuple x G D"*, we denote its 
ith entry by x[i] for 1 < i < m. Any mapping / : —> D is called a A:-ary operation] f is called 

conservative if /(xi,..., x^) G {xi,..., x^} and idempotent if /(x,..., x) = x. We will apply a 
fc-ary operation f to k m-tuples xi,... ,Xfe G D”* coordinatewise, that is, 

/(xi,...,xfc) = (/(xi[l],...,xfc[l]),...,/(xi[m],...,xfc[m])). (2) 

Definition 7. Let be an m-ary weighted relation on D. A k-ary operation f on D is a poly¬ 
morphism of 4> if, for any xi,... ,Xfc G D™ with Xj G Feas(^) for all 1 < i < k, we have that 
/(xi,... ,Xfc) G Feasifi). 

For any valued constraint language P over a set D, we denote by Pol(r) the set of all operations 
on D which are polymorphisms of all 0 G P. We write Pol((/>) for Pol({(/)}). 

A k-ary projection is an operation of the form tt\^\xi, ... ,Xk) = Xj for some 1 < z < A:. 
Projections are polymorphisms of all valued constraint languages. 

The composition of a k-ary operation / : D with k Gary operations gi : ^ D for 

1 < z < /c is the Gary function f[gi,---,gk] '■ ^ D defined by 

f[9i,---,9k]{xi,...,Xi) = f{gi{xi,...,xe),...,gk{xi,...,xi)). (3) 

(k) 

We denote hy Od the set of all finitary operations on D and by Ofi the k-ary operations in 
Od. 

A clone of operations, C V Oo, \s a set of operations on D that contains all projections and 
is closed under composition. It is easy to show that Pol(r) is a clone for any valued constraint 
language P. 
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(k) 

Definition 8. A k-ary fractional operation oj is a probability distribution over O)^ . We define 
supp(a;) = {/ G | w(/) > 0}. 

Definition 9. Let be an m-ary weighted relation on D and let to be a k-ary fractional operation 
on D. We call oj a fractional polymorphism of (j) */supp(a;) C Pol((^) and for any xi,..., € D™ 

with Xj G Feas((;i)) for all 1 < i < k, we have 

E [(/'(/(xi,... ,Xk))] < avg{(/>(xi),... Xxk)} . (4) 

f^UJ 

We also say that is improved by oj. 

Definition 10. For any valued constraint language F C we define fPol(F) to be the set of all 
fractional operations that are fractional polymorphisms of all weighted relations </> G F. We write 
fPol((/.) for fPol({0}). 

Example 2. A valued constraint language on domain {0,1} is called submodular if it has the frac¬ 
tional polymorphism oj defined by a; (min) = ^(max) = where min and max are the two binary 
operations that return the smaller and larger of its two arguments respectively with respect to the 
usual order 0 < 1. 

Definition 11. Let T be a valued constraint language on D. We define 

supp(r) = IJ supp(u;). (5) 

tjefPoi(r) 

Lemma 1. Let T be a valued constraint language of finite size. Then, supp(r) is a clone. 

We note that Lemma [T] has also been observed in |22] and in HU. 

Proof. Observe that supp(F) contains all projections as G fPol(r) for every A: > 1, where is 
the fractional operation defined by Tfc(7rp^) = ^ for every 1 < i < k. Thus we only need to show 
that supp(r) is closed under composition. 

Since oj G supp(r) there is k-ary oj G fPol(r) with u}{f) > 0. Moreover, since gi,...,gk G 
supp(F), for every 1 < i < k there is .^-ary fVi G supp(r) with fifigi) > 0. We define an Aary 
fractional operation 

^'{p) = Pr ...,hk]=p] . (6) 

Since uj{f) > 0 and Hiigi) > 0 for all 1 < z < k, we have uj'{f[gi,... ,gk]) > 0. A straightforward 
verification shows that oj' G fPol(r). Consequently, f[gi,... ,gk] G supp(r). □ 

The following lemma is a generalisation of |28( Lemma 5] from arity one to arbitrary arity and 
from finite-valued to valued constraint languages, but the proof is analogous. A special case has 
also been observed, in the context of Min-Sol problems [30], by Hannes UppmanH 

Lemma 2. Let T be a valued constraint language of finite size on a domain D and let f G Pol(F). 
Then, f G supp(F) if, and only if, f G Pol(Opt(/)) for all instances L of VCSP{T). 

^Private communication. 
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Proof. The operation / is in supp(r) if, and only if, there exists a fractional polymorphism w with 
/ € supp(w). This is the case if, and only if, the following system of linear inequalities in the 
variables uj{g) for g € Pol(r) is satisfiable: 

w( 5 r)(/>(/(xi,...,Xfc)) < avg{(/)(xi),...,(/>(xfc)}, V0 G r,Xi G Feas((/)), 

gGPol(r) 

^^3) = 1, 

gePoi(r) 

uj{f) > 0, 

a;(5)>0, V^gPoKT). (7) 

By Parkas’ lemma, the system ([7|) is unsatisfiable if, and only if, the following system in variables 
... ,Xfc), for (/) G r,Xj G Feas(0), is satishable: 

... ,Xfc) (avg{(/>(xi),... ,0(xfc)} - 4>{g{^i,.. • ,Xfc))) <0, G Pol(r), 

0Er,XiGFeas((;6) 

... ,Xfc) (avg{(/>(xi),... ,(/>(xfc)} - 0(/(xi,... ,Xfc))) < 0, 

0Gr,XiEFeas(0) 

... ,Xfc) > 0, V(/> G r,Xj G Feas{(f). 

(8) 

First, assume that / 0 supp(r) so that ([8]) has a feasible solution z. Note that by scaling we 
may assume that is integral. Then, z can then be interpreted as an instance If of VCSP(r) in 
which we take as variables the /c-tuples of D, V = D^, and let 

z{4>,xi ,... ,Xfc)(?i((xi[l],... ,Xfc[l]),..., (xi[ar(</))],...,Xfc[ar((/>)])), 

0^r,Xi^Feas(0) 

where x is a list of the variables in V, and the multiplication by 2 : is represented as taking the 
corresponding constraint with multiplicity 2 . According to ([8|), any projection —)■ D, 

7rl^\xi,... ,Xk) = Xi is an optimal assignment to If. Interpreted as tuples, we therefore have 
G Opt(/) for 1 < i < k. On the other hand, ([8|) states that / is not an optimal assignment, so 
/(7r^^\ ..., 0 Opt(//). In other words, / ^ Pol(Opt(I/)). 

For the opposite direction, assume that / G supp(r), so that ([8]) is unsatisfiable. Let I be an 
arbitrary instance of VCSP(F), and let cJi,..., cr^ G Opt(/) be k optimal solutions to I. Construct 
an instance Z of VCSP(F) with variables by replacing each valued constraint (t>i{xi) in I by 
0j((Ti(xj),... ,(Tfc(xj)), in Z, where (cri(xj),... ,(Tfc(xj)) is a tuple of variables in Now, 

if / were not an optimal solution to Z, then Z would be a solution to ([8]), a contradiction. Hence 
/ G Pol(Opt(/)). Since I and Uj were chosen arbitrarily, this establishes the lemma. □ 

2.3 Cores and Constants 

Definition 12. Let T he a valued constraint language with domain D and let S Ci D. The sub¬ 
language r[5] of F induced by S is the valued constraint language defined on domain S and con¬ 
taining the restriction of every weighted relation (/> G F onto S. 

Definition 13. A valued constraint language F is a core if all unary operations in supp(r) are 
bijections. A valued constraint language F' is a core of F i/F' is a core and F' = r[/(D)] for some 
f G supp(u;) with oj a unary fractional polymorphism o/F. 
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The following lemma implies that when studying the computational complexity of a valued 
constraint language T way may assume that T is a core. 

Lemma 3. Let V he a valued constraint language and T' a core ofT. Then, for all instances I of 
VCSPfr) and I' of VCSP{T'), where I' is obtained from I by substituting each function in T for 
its restriction in T', the optimum of land I' coincide. 

A special case of Lemma [3] for finite-valued constraint languages was proved by the authors 
in m- Lemma [3] has also been observed in [22] and in another recent paper of the authors [29| . 

Proof. By definition, L' = r[/(Z))], where D is the domain of L and / G supp(u;) for some unary 
fractional polymorphism w. Assume that I is satisfiable, and let a be an optimal assignment to I. 
Now /o fj is a satisfying assignment to I', and by Lemma [21 f oa is also an optimal assignment to 
I. Conversely, any satisfying assignment to I' is a satisfying assignment to I of the same value. □ 

Let Cd = {{(d)} I d G D} be the set of constant unary relations on the set D. 

Lemma 4 fj22ji. Let T be a core valued constraint language. The problems VCSPfT) and VCSP{T UCd) 
are polynomial-time equivalent. 

A special case of Lemma 0] for finite-valued constraint languages was proved by the authors 
in m, building on |15j . and Lemma 0] can be proved similarly; we refer the reader to |22j . 

3 Sherali-Adams Relaxations and Valued Relational Width 

In this section, we state and prove our main result on the applicability of Sherali-Adams relaxations 
to VCSPs. First, we define some notions concerning bounded relational width which is the basis for 
our proof. 

We write (S', C) for (valued) constraints that involve (unweighted) relations, where S is the 
scope and C is the constraint relation. For a tuple x G , we denote by 7r5/(x) its projection onto 
S' C S. For a constraint (S, C), we define tts'{C) = {7r5/(x) | x G C}. 

Let 1 < A; < ^ be integers. The following definition is equivalent!! to the definition of 
minimality for CSP instances given in [1]. 

Definition 14. A CSP-instance J = {V,D,{{Si,Ci)}1^.^) is said to be (A:,£)-minimal if: 

• For every S CV, |S| < there exists 1 < i < q such that S = Si. 

• For every i,jG [<?] such that |Sj| < A: and Sj C Si, Cj = TTSj{Ci). 

There is a straightforward polynomial-time algorithm for finding an equivalent (A:, ^)-minimal 
instance [T]. This leads to notion of relational width: 

Definition 15. A constraint language A has relational width {k,i) if, for every instance J G 
CSP(A), an equivalent {k,i)-minimal instance is non-empty if, and only if, J has a solution. 

A k-avy idempotent operation / : —>■ D is called a weak near-unanimity (WNU) operation 

if, for all x,y G D, 


f{y, x,x,...,x) = f{x, y,x,x,... ,x) = f{x, x,...,x,y). 

®The two requirements in [1] are: for every S QV with |S'| < £ we have S C Si for some 1 < * < q; and for every 
set W V with \W\ < k and every 1 < i, j < q with VK C Si and W C Sj we have nw{Ci) = TvwiCj). 
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Definition 16 (BWC). We say that a clone of operations satisfies the bounded width condition 
(BWC) if it contains WNU operations of all but finitely many arities. 

Theorem 1 ([3l|2T]). Let A be a constraint language of finite size containing all constant unary 
relations. Then, A has bounded relational width if, and only if, Pol(A) satisfies the BWC. 

Theorem 2 (PQ). Let A be a constraint language. If A has bounded relational width, then it has 
relational width (2,3). 

Let I{xi, ... ,Xn) = be an instance of the VCSP, where Si C V = {xi,... ,Xn} 

and (fi- —)• Q. First, we make sure that every non-empty S T V with |5| < £ appears in 

some term 4>i{S), possibly by adding constant-0 weighted relations. The Sherali-Adams [23] linear 
programming relaxation with parameters {k,£) is defined as follows. The variables are Aj(s) for 
every i G [g] and tuple s G . 

min ^ ^ Ai(s)(/.i(s) 

2=1 s£Feas{(l)i) 


II 

M 

£ [<?] s.t. Sj C Si, ISj < k,t G 

(9) 

s£DSi,nsfis)=t 

Ai(s) = 1 

Vi G [g] 

(10) 

.&D^i 

o 

II 

\/i G [q] ,s ^ Feas((/)i) 

(11) 

Ai(s) > 0 

Vi G [g], s G 

(12) 


The SA(A;, £) optimum is always less than or equal to the VCSP optimum, hence the program 
is a relaxation. In anticipation of our main theorem, we make the following definition. 

Definition 17. A valued constraint language P has valued relational width {k,£) if, for every 
instance I o/VCSP(r), if the SA{k,i)-relaxation of I has a feasible solution, then its optimum 
coincides with the optimum of I. 

For a feasible solution A of SA(A:,^), let supp(Aj) = {s G \ Ai(s) > 0}. 

Lemma 5. Let I be an instance of VCSP{T). Assume that SA{k,£) for I is feasible. Then, there 
exists an optimal solution A* to SA{k,£) such that, for every i, supp(A*) is closed under every 
operation in supp(r). 

Proof. Let tv be an arbitrary m-ary fractional polymorphism of F, and let A be any feasible solution 
A to SA(A;,^). Define A^^ by 


Ki^)= Pr [/(si,...,s^) = s]. 

S1,...,S77t,~A2 

We show that A“ is a feasible solution to SA(k,i), and that if A is optimal, then so is A'^. 

Clearly Xf is a probability distribution for each i G [q], so IfTO]) and (fT2]) hold. Since a; is a 
fractional polymorphism of F, we have s G Feas((/)j) for any choice of / G supp(a;) and si,..., G 
supp(Ai). Hence, A^(s) = 0 for s 0 Feas((/)i), so (fTTI) holds. 


Finally, let j G [( 7 ] be such that Sj C Si, |5j| < k, and let t G . Then, 

Pr [/(si,...,s^) = s] 

J'^LO 

se-D®i,7rs^.(s)=t seD^i,TTSjis)=t Sl,...,Sm~Ai 

= Pr ['^Sj{f{si,...,Sm)) =t] 

f^UJ 

= Pr [ti =7rs (si) A---Atm = 7rs (si) A/(ti,...,tm) =t] 

Si ,...,S77i'^Aj 

= Pr [/(ti,...,tm) =t] 

f^U) 

'tl,.**?^m'^Aj 

= A,"(t), 

where, in the penultimate equality, we have used the fact that Q can be read as Xj (t) = Prg^Ai (s) = f] • 
It follows that ([9]) also holds for A^, so A'^ is feasible. 

For each i £ [< 7 ], we have 

m 

^ Xi{s)(pi{s) = E 0i(s) = E 

sGFeas(<;ii) 

> E 0i(/(si, . . . ,Sm)) 

= Z] ( [/(si,...,Sm) =s])(/)i(s) 

seFeas((/)i) si,...,s^~Ai 

= E ^ns)A(s). 

s€Feas(0i) 

Therefore, if A is optimal, then A“ must also be optimal. 

Now assume that A is an optimal solution and that supp(A) is not closed under some operation 
/ G supp(ti;) for cj G fPol(F), i.e., for some si,... ,Sm G supp(A), we have /(si,... ,Sm) ^ supp(A). 

But note that /(si,... ,Sm) G supp(A^). Therefore, A' = ^(A + A^^) is an optimal solution such that 
supp(Ai) C supp(Al) C D^\ For each i G [g], is finite. Hence, by repeating this procedure, we 
obtain a sequence of optimal solutions with strictly increasing support until, after a finite number 
of steps, we obtain a A* that is closed under every operation in supp(F). □ 

Theorem 3. Let T be a valued constraint language of finite size containing all constant unary 
relations. i/supp(F) satisfies the BWC, then F has valued relational width (2,3). 

Proof. Let I be an instance of VCSP(F). The dual of the SA(A:, i) relaxation can be written in the 
following form. The variables are Zi for i G [g] and yj,t,i for i,j G [g] such that Sj C Si, l^jl < k, 
and t G . 
g 

max Zi 

i=l 


Zi < 4>i{s) + 


Y1 y^^d 

Vi G [g] ; 


< k,s £ Feas((/>j) 

(13) 


jelg],SjCSi 

j&[q],SiCSj 





Zi < 4>i{s) + 

Y1 


Vi G [g] ; 

ASi\ 

> k,s £ Feas((/>j) 

(14) 


jelg],SjCSi 
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It is clear that if I has a feasible solution, then so does the SA(k, i) primal. Assume that the 
SA(2,3)-relaxation has a feasible solution. By Lemma El there exists an optimal primal solution 
A* such that, for every i G [g], supp(A*) is closed under supp(r). Let y*, z* be an optimal dual 
solution. 

Let A = {Ci}j^^[J{CD}, where Q = supp(A*), and consider the instance J = {V, D, {(5j, 
of CSP(A). We make the following observations: 

1. By construction of A*, supp(r) C Pol(A), so A contains all constant unary relations and 
satisfies the BWC. By Theorems [H and [2l the language A has relational width (2,3). 

2. The constraints ([9]) say that if i,j € [(?], |S'j| < 2 and Sj C Si, then A*(t) > 0 (i.e., t € Cj) if, 
and only if, Z]sGD®i, 7 rs.(s)=t (®) > ^ (i.e., t G TTSjiCi)). In other words, J is (2,3)-minimal. 

These two observations imply that J has a satisfying assignment a: V ^ D. 

By complementary slackness, since X*{a{Si)) > 0 for every i G [g], we must have equality in the 
corresponding rows in the dual indexed by i and (7{Si). We sum these rows over i: 




2 = 1 


2=1 


ie[g],SjC5i i&[q] j&[q],SiQSj 

|S’d<2 |5i|<2 


(15) 


By noting that T^s (.<^{Si)) = (T{Sj), we can rewrite the expression in parenthesis on the right- 
hand side of ([TE]) as: 

E yUsi),i- E yUs,),i = o- (i 6 ) 

|Sj|<2 |5i|<2 


Therefore, 


2=1 sGFeas(0i) 


2 = 1 


2 = 1 


where the first equality follows by strong LP-duality, and the second by (IlSp and (1161) . 

Since I was an arbitrary instance of VCSP(r), we conclude that T has valued relational width 
(2,3). □ 


4 Generalisations of Known Tractable Languages 

In this section, we give some applications of TheoremEl Firstly, we show that the BWC is preserved 
by going to a core and the addition of constant unary relations. 

Lemma 6. Let T be a valued constraint language of finite size on domain D and T' a core of T 
on domain D' C D. Then, supp(r) satisfies the BWC if, and only if, supp(r' UCd') satisfies the 
BWC. 

Proof. Let yhe a unary fractional polymorphism of T with an operation g in its support such that 
g{D) = D'. We begin by constructing a unary fractional polymorphism y! of T such that every 
operation in supp{y') has an image in D'. 

We will use a technique for generating fractional polymorphisms described in m Lemma 10]. 
It takes a fractional polymorphism, such as y, a set of collections G, which in our case will be the 
set of operations in the clone of supp(/r), a set of good collections G*, which will be operations 
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from G with an image in D', and an expansion operator Exp which assigns to every collection a 
probability distribution on G. 

The procedure starts by generating each collection / G supp(/i) with probability and 

subsequently the expansion operation Exp maps / G G to the probability distribution that assigns 
probability Pr/j^^[/i o / = /'] to each operation /' G G. The expansion operator is required to 
be non-vanishing, which means that starting from any collection / G G, repeated expansion must 
assign non-zero probability to a good collection in G*. In our case, this is immediate, since starting 
from a collection /, the good collection g o f gets probability at least fj.{g) which is non-zero by 
assumption. By m Lemma 10], it now follows that T has a fractional polymorphism //' with 
supp(//') C G*. So every operation in supp(/r') has an image in D\ 

Now, we show that if supp(r) contains an m-ary WNU t, then supp(r' U Cjji) also contains 
an m-ary WNU. Let a; be a fractional polymorphism of T with t in its support. Define oj' by 
JW) = o / = /']. Then, oj' is a fractional polymorphism of T in which every 

operation has an image in D', so uj' is a fractional polymorphism of Th Furthermore, for any 
unary operation h G supp(^'), h o t \s again a WNU, so supp(r') contains an m-ary WNU t'. 
Next, let h{x) = t'{x,... ,x). Since T' is a core, the set of unary operations in supp(r') contains 
only bijections and is closed under composition (Lemma [T]). It follows that h has an inverse 
h~^ G supp(r'), and since supp(r') is a clone, h~^ o t' is an idempotent WNU in supp(r'). We 
conclude that h~^ ot' £ supp(r' U {Cd'})- 

For the opposite direction, let t' be an m-ary WNU in supp(F'u{C£)'}), and let oj' be a fractional 
polymorphism of F' U {Cd'} with t' in its support. Then, oo' is also a fractional polymorphism of 
F'. Define ui by io{f) = , h] = f]. Then, a; is a fractional polymorphism of F, 

and, for every h G supp(/r'), the operation t[h, ..., h] is an m-ary WNU in supp(a;). We conclude 
that t G supp(F), which finishes the proof. □ 

Hence the BWC guarantees valued relational width (2, 3) also for languages not necessarily 
containing constant unary relations, as required by Theorem [3l 

Theorem 4. Let T he a valued constraint language of finite size. //supp(F) satisfies the BWC, 
then F has valued relational width (2,3). 

Proof. Let D be the domain of F, and D' Q D the domain of a core F' of F. By Lemma [6] and 
Theorem [31 the language F' U {Cd'} has valued relational width (2,3), so clearly F' has valued 
relational width (2, 3) as well. Every feasible solution to the SA(2,3)-relaxation of an instance I' 
of VCSP(F') is also a feasible solution to the SA(2,3)-relaxation of the corresponding instance I of 
VCSP(F). The result now follows from Lemma [3] as the optimum of I' and I coincide. □ 

Secondly, we show that for any VCSP instance over a language of valued relational width (2,3) 
we can not only compute the value of an optimal solution but we can also find an optimal assignment 
in polynomial time. 

Proposition 5. Let T he a valued constraint language of finite size and I an instance of VCSP{T). 
//supp(F) satisfies the BWC, then an optimal assignment to L can he found in polynomial time. 

Proof. Let F' be a core of F on domain D', and let Fc = F'u{C£)'}. By LemmalU supp(Fc) satisfies 
the BWC, so by Theorem [3] we can obtain the optimum of I by solving a linear programming 
relaxation. Now, we can use self-reduction to obtain an optimal assignment. It suffices to modify 
the instance I to successively force each variable to take on each value of D'. Whenever the optimum 
of the modified instance matches that of the original instance, we can move on to assign the next 
variable. This means that we need to solve at most 1 -|- |U| |D'| linear programming relaxations 
before finding an optimal assignment, where V is the set of variables of /. □ 
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Finally, we show that testing for the BWC is a decidable problem. We rely on the following 
result that was proved in |19j . and also follows from results in [T]. 

Theorem 6 ([E]). An idempotent clone C of operations satisfies the BWC if, and only if, C 
contains a ternary WNU f and a A-ary WNU g with f{y,x,x) = g{y,x,x,x) for all x and y. 

Proposition 7. Testing whether a valued constraint language of finite size satisfies the BWC is 
decidable. 

Proof. Let F be a valued constraint language of finite size on domain D. Let F' be a core of F defined 
on domain D' T D. Finding D' and F' can be done via linear programming [28t Section 4], By 
Lemma[6l supp(F) satisfies the BWC if, and only if, supp(F' UC/)/) satisfies the BWC. As constant 
unary relations enforce idempotency, by Theorem[6l supp(F' UC/)/) satisfies the BWC if, and only 
if, supp(F' CC£)t) contains a ternary WNU / and a 4-ary WNU g with f{y,x,x) = g{y,x,x,x) for 
all x and y. It is easy to write a linear program that checks for this condition, as it has been done 
in the context of finite-valued constraint languages [28l Section 4]. □ 

4.1 Tractable Languages 

Here we give some examples of previously studied valued constraint languages and show that, as a 
corollary of Theorem U they all have valued relational width (2,3). 

Example 3. Let a; be a ternary fractional operation defined by uj{f) = co{g) = uj{h) = | for some 
(not necessarily distinct) majority operations /, g, and h. Cohen et al. proved the tractability of 
any language improved by w by a reduction to CSPs with a majority polymorphism [8]. 

Example 4. Let w be a ternary fractional operation defined by oj{f) = | and oj{g) = where 
/ : {0, 1}^ — )■ {0, 1} is the Boolean majority operation and g : {0, 1}^ —)■ {0, 1} is the Boolean 
minority operation. Cohen et al. proved the tractability of any language improved by w by a 
simple propagation algorithm [5]. 

Example 5. Generalising Example[l]from Boolean to arbitrary domains, let w be a ternary fractional 
operation such that oj{f) = g, oj{g) = and uj{h) = ^ for some (not necessarily distinct) majority 
operations / and g, and a minority operation h; such an uj is called an MJN. Kolmogorov and 
Zivny proved the tractability of any language improved by w by a 3-consistency algorithm and a 
reduction, via Example El to submodular function minimisation |18] . 

The following corollary of Theorem U] generalises Examples [3]l5l 

Corollary 1. Let T be a valued constraint language of finite size such that supp(F) contains a 
majority operation. Then, F has valued relational width (2,3). 

Proof. Let / be a majority operation in supp(F). Then, for every k > 3, f generates a WNU g^ 
of arity k: gk{xi,... ,Xk) = f{xi,X 2 ,xfi). By LemmalU supp(F) is a clone, so gk € supp(F) for all 
k >3. Therefore, supp(F) satisfies the BWC and the result follows from Theorem 01 □ 

Example 6. Let cj be a binary fractional operation dehned by uj{f) = oj{g) = where / and g 
are conservative and commutative operations and f{x, y) g{x, y) for every x and y, such an uj is 
called a symmetric tournament pair (STP). Cohen et al. proved the tractability of any language 
improved by a; by a 3-consistency algorithm and an ingenious reduction to submodular function 
minimisation [7]. Such languages were shown to be the only tractable languages among conservative 
finite-valued constraint languages [18] . 

The following corollary of Theorem 0] generalises Example El 
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Corollary 2. Let T be a valued constraint language of finite size such that supp(r) contains two 
symmetric tournament operations (that is, binary operations f and g that are both conservative and 
commutative and f{x,y) 7 ^ g{x,y) for every x and y). Then, F has valued relational width (2,3). 

Proof. It is straightforward to verify that h{x,y,z) = f{f{g{x,y),g{x,z)),g{y,z)) is a majority 
operation, as observed in [Tj Corollary 5.8]. The claim then follows from Corollary [TJ □ 

Example 7. Generalising Example^ let u; be a binary fractional operation dehned by uj{f) = oj{g) = 
where / and g are conservative and commutative operations; such an oj is called a tournament 
pair. Cohen et al. proved the tractability of any language improved by a; by a consistency-reduction 
relying on Bulatov’s result [4], which in turn relies on 3-consistency, to the STP case from Exam¬ 
ple [ 6 ] [7]. 

The following corollary of Theorem U] generalises Example [71 

Corollary 3. Let T be a valued constraint language of finite size such that supp(r) contains a 
tournament operation (that is, a binary conservative and commutative operation). Then, T has 
valued relational width (2,3). 

Proof. Let / be a tournament operation from supp(r). We claim that / is a 2-semilattice; that 
is, / is idempotent, commutative, and satisfies the restricted associativity law f{x,f{x,y)) = 
f{f{x,x),y). To see that, notice that f{x,f{x,y)) = x \i f{x,y) = x and f{x,f{x,y)) = y if 
f{x,y) = y, together, f{x,f{x,y)) = f{x,y). On the other hand, trivially f{f{x,x),y) = f{x,y). 
Also note that f{x,f{y,x)) = f{x,f{x,y)) = f{x,y), so / is a ternary WNU. Eor every k > 3, 
f generates a WNU gt of arity k\ gk{xi, ...,Xk) = /(/(... (/(xi, X 2 ), 0 : 3 ),.. .),Xk). By Lemma [H 
supp(r) is a clone, so gk G supp(r) for all k > 3. Therefore, supp(r) satisfies the BWC so the 
result follows from Theorem [H □ 

Example 8 . In this example we denote by {{...}} a multiset. Let w be a binary fractional operation 
on D defined by ui{f) = oj{g) = ^ and let /r be a ternary fractional operation on D defined by 
yi{hi) = /i(/i 2 ) = /i(/i 3 ) = Moreover, assume that {{/(x, y),y(x, y)}} = {{x,y}} for every x and 
y and {{/ii(x, y, z), h 2 (x, y, z),/i 3 (x, y, z)}} = {{x,y, 2 :}} for every x, y, and 2 . Let T be a language 
on D such that for every two-element subset {a, 6 } C D, either w|{a,b} is an STP or y|{a, 6 } is 
an MJN. Kolmogorov and Zivny proved the tractability of P by a 3-consistency algorithm and a 
reduction, via Example El to submodular function minimisation [18]. Such languages were shown 
to be the only tractable languages among conservative valued constraint languages [T 8 |. We will 
discuss conservative valued constraint languages in more detail in Section 14.21 

The following corollary of Theorem 01 covers Example El 

Corollary 4. Let T be a valued constraint language of finite size with fractional polymorphisms u! 
and y as described in Example\^ Then, P has valued relational width (2,3). 

Proof. Let P be the set of 2-element subsets of D such that is an STP for {a,b} G 

P and p.\{a,b} is an MJN for {a, 5} 0 P. Let p{x,y,z) = f{f{g{y,x),g{x,z)),g{y,z)). Ob- 

serve that p\{a,h} is a majority for {a, 6 } € P, and p\{a,b} is either vr)or -k). ^ 

P (possibly different projections for different 2-element subsets from P). Now let q{x,y,z) = 
p{hi{x,y,z),h 2 {x,y,z),h 3 {x,y,z)). For x,y G {a,b} G P, q{x,x,y) = q{x,y,x) = q{y,x,x) = 
P{{{x, X, y}}) = x. For x, y G {a, b} 0 P, q{x, x, y) = q{x, y, x) = q{y, x, x) = p{x, x,y) = x as p is 
either the first or the second projection. Thus, q is a majority operation. The claim then follows 
from Corollary [H □ 
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4.2 Dichotomy for Conservative Valued Constraint Languages 

A valued constraint language F is called conservative if F contains all unary {0, l}-valued weighted 
relations. Kolmogorov and Zivny gave a dichotomy theorem for such languages, showing that 
they are either NP-hard, or tractable, cf. Example [H Here we prove this dichotomy using the 
SA(2,3)-relaxation as the algorithmic tool. 

First, we will need a technical lemma showing that the Opt operator preserves tractability. 

Lemma 7. Let T be a valued constraint language and I an instance of VCSP{T). Then, VCSPfTU 
{Opt(/)}) polynomial-time reduces to VCSP{T). 

Proof. Let F' = F U {Opt(/)}. Let J' = Yli=i be an arbitrary instance of VCSP(F'). We 

will create an instance J of VCSP(F) such that if the optimum of J is too large, then J' is not 
satisfiable, and otherwise the optimum of J' can be computed from the optimum of J. The variables 
of J are the same as for J'. Let be any valued constraint in J'. If (/>j € F then we add the 

valued constraint ^^(xj) to J. Otherwise (pi = Opt(/). In this case, we add C copies of /(xj) to 
the instance J, where C is a number that will be chosen large enough so that if J' is satishable, 
then in any optimal assignment to J, the variables Xj will be forced to be an optimal solution to 
the instance I. In such a solution, Xj G Opt (I), and we can recover an optimal solution to J'. 

The value of C is chosen as follows: if I does not have any sub-optimal satisfying assignment, 
then let (7 = 1. Otherwise, let (7 = \{U — L + I)/A], where U is an upper bound on the optimal 
value of J', L is a lower bound on the optimal value of J', and A is the least difference between a 
sub-optimal and an optimal assignment to I. Both U and L can be computed in polynomial time 
by taking the sum of the largest, respectively smallest, finite values of each valued constraint. The 
value of (7 depends linearly on the number of constraints in J', so the size of J is polynomial in 
the size of J'. 

Let min(J), min(J'), and min(/) denote the optimal value of the respective instance. Assume 
first that J' has a satisfying assignment. Then, this assignment is also a satisfying assignment to 
J, so 

min(J) < (7iVmin(/) -|-min(J'), (17) 

where N is the number of occurrences of Opt(/) in J'. 

If J has a satisfying assignment a, then we distinguish two cases. First, assume that a assigns 
an optimal value to every copy of I. Then, a is also a satisfying assignment of J', so 

min(j') < Val((T) — (7Vmin(/), (18) 

where Val((T) denotes the value of a. From (I17p and (jl8h . we see that if a is an optimal assignment 
to J, so that Val((T) = min(J), then it is also an optimal assignment to J'. 

Otherwise, a assigns a sub-optimal value to at least (7 copies of I, so 

Val((7) > (7(min(/) -|- A) -|- C{N — 1) min(/) -|- min(j') > {U — L + 1) + CN min(/) -|- L. (19) 

In this case, min(J) > (7iVmin(/) -\-U > CN mm{I) min(J'), so by (|17p . we see that J' cannot 
satisfiable. 

In summary, if J is unsatisfiable, or if min(J) > (7Vmin(/) -|- U, then J' is unsatisfiable, and 
otherwise min(J') = min(J) — (7Vmin(/). □ 

The following theorem was proved by Takhanov [25] with a reduction, essentially amounting to 
Lemma in added in [18] . 
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Theorem 8 ( |18ll25j h Let T he a conservative valued constraint language. If Pol(r) does not 
contain a majority polymorphism, then T is NP-hard. 

Theorem 9. Let T he a conservative valued constraint language. Either F is NP-hard, or T has 
valued relational width (2,3). 

Proof. Let F be the set of majority operations in Pol(r) \ supp(r). By Lemma[51 for each f ^ F, 
there is an instance If of VCSP(r) such that / 0 Pol(Opt(/j)). Let P' = P U {Opt(/j) | / € F}. 
Assume that Pol(r') contains a majority polymorphism /. Then, / 0 T, so / € supp(r). From 
Corollarylll it follows that P has valued relational width (2,3). If Pol(r') does not contain a majority 
polymorphism, then, since P is conservative, so is P', and hence P' is NP-hard by Theorem [8l 
Therefore, P is NP-hard by Lemma [71 □ 

5 Conclusions 

We have shown that most previously studied tractable valued constraint languages that are not 
purely relational fall into the cases covered by Theorem [H There is however one class of languages 
which we have not succeeded in analysing. These are the valued constraint languages improved by 
a so-called generalised weak tournament pair (GWTP) identified in Uppman [30]. The definition of 
this class is rather intricate and we pose as an open problem the question whether such languages 
have valued relational width (2,3). 

Problem 1. Do valued constraint languages improved by a generalised weak tournament pair have 
valued relational width (2,3)? 
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